A new Metric for the Evaluation of Dialog Act Classification∗
نویسندگان
چکیده
The standard evaluation metrics for dialog act classifiers are based on the boolean outcome of the exact classification. For multidimensional tag sets, such as the ICSI-MRDA tag set, this is stricter than necessary, since the missclassification might be partial and this can be good enough for the application in which the classifier is embedded. We propose a new forgiving metric and show some preliminary results. Some future work is sketched.
منابع مشابه
NEW CRITERIA FOR RULE SELECTION IN FUZZY LEARNING CLASSIFIER SYSTEMS
Designing an effective criterion for selecting the best rule is a major problem in theprocess of implementing Fuzzy Learning Classifier (FLC) systems. Conventionally confidenceand support or combined measures of these are used as criteria for fuzzy rule evaluation. In thispaper new entities namely precision and recall from the field of Information Retrieval (IR)systems is adapted as alternative...
متن کاملAn Investigation into the Relationship between Dialog and Narrative Elements of the Holy Quran from a Literary Perspective
After more than 14 centuries, the expressive inimitability of the holy Quran opens new dimensions for thinkers every day. One of these angles is the study of the story and its relation to the element of dialog. The purpose of this article is to look into this issue in the verses of the holy Quran. For this purpose, the methods and techniques of storytelling in the Quran, the characteristics of ...
متن کاملA Multi-Metric Index for Hydrocarbons Source Apportionment
Several studies have been conducted to develop more accurate and precise indices for hydrocarbons source apportionment. The present study, however, develops a new multi-metric index for hydrocarbons source apportionment. It measures Poly Aromatic Hydrocarbons (PAHs) concentration at six stations with well known petrogenic origin, calculating Phe/An, Flu/Py, Chr/BaA, BaA/Chr, An/(An+Ph), Flu/(Fl...
متن کاملA Multi-Metric Index for Hydrocarbons Source Apportionment
Several studies have been conducted to develop more accurate and precise indices for hydrocarbons source apportionment. The present study, however, develops a new multi-metric index for hydrocarbons source apportionment. It measures Poly Aromatic Hydrocarbons (PAHs) concentration at six stations with well known petrogenic origin, calculating Phe/An, Flu/Py, Chr/BaA, BaA/Chr, An/(An+Ph), Flu/(Fl...
متن کاملEnsemble Classification and Extended Feature Selection for Credit Card Fraud Detection
Due to the rise of technology, the possibility of fraud in different areas such as banking has been increased. Credit card fraud is a crucial problem in banking and its danger is over increasing. This paper proposes an advanced data mining method, considering both feature selection and decision cost for accuracy enhancement of credit card fraud detection. After selecting the best and most effec...
متن کامل